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(54) Server for interactive distribution of audio/video programmes over telecommunication 
networks 



(57) An audio/video media server for distributed ed- 
iting over networks receives requests from clients on the 
networks that include a clip identifier, a delivery desti- 
nation identifier and the frame numbers from the clip de- 
sired. The media server parses the requests and asyn- 
chronously accesses a file system to retrieve the re- 
- quested media frames from a storage medium. The re- 



trieved media frames are asynchronously transferred to 
a FIFO buffer, and a clock rate for a local clock is ad- 
justed according to the fullness of the buffer. The media 
frames from the buffer are sent in the form of data pack- 
ets over the networks in response to interrupts generat- 
ed by the local clock. In this manner the timing for the 
media frames is controlled by the clients to assure a con- 
tinuous stream of video during editing. 
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Description 

CROSS-REFERENCE TO RELATED APPLICATIONS 

[0001] Not applicable s 

STATEMENT REGARDING FEDERALLY 
SPONSORED RESEARCH OR DEVELOPMENT 

[0002] This invention was developed under a federal- 10 
ly sponsored research project, and the United States 
Government has certain rights as specified in the United 
States Department of Commerce Contract Number 
70NANB5H1176. 

15 

BACKGROUND OF THE INVENTION 

[0003] The present invention relates to the distribution 
of packetized data over networks, and more particularly 
to an audio/video media server for distributed editing 20 
over networks using a low-resolution format or a high- 
resolution format, depending upon the available net- 
work bandwidth. 

[0004] Existing media servers stream video and audio 
packets over a network under control of a server. A client 25 
consumes video at whatever rate the server sends the 
packets — the client consumes a contiguous movie. In 
other words the current media servers "push" media 
from the server to the client using a "stream" from the 
server. These servers are often called "video on de- 30 
mand" servers, however they refer to the delivery of con- 
tiguous movies, not in-progress material suitable for an 
edit session. 

[0005] In an editing environment a client is looking to 
put together a "movie" from a plurality of video clips that 3s 
may be distributed over a plurality of servers. With the 
"video on demand" servers the timing of the video to the 
client is determined by the servers. To provide concate- 
nated clips, especially when a first clip is from one server 
and a second clip is from another server, the timing issue 40 
is "when does the second server start to 'push' the sec- 
ond clip?" This presents a very complex timing problem. 
[0006] What is desired is an audio/video media server 
for distributed editing over a network that allows clients 
to access media from many distributed servers or even 
different media files on a server to enable the playing of 
"edited" movies with the timing controlled by the client. 

BRIEF SUMMARY OF THE INVENTION 

so 

[0007] Accordingly the present invention provides an 
audio/video media server for distributed editing over a 
network by responding in an asynchronous manner to 
media frame requests from one or more clients. Each 
request contains a clip identifier, a delivery destination ss 
and the frames desired from the clip. The media server 
asynchronously accesses a file system to retrieve the 
media frames from a storage medium. The media 
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frames are then asynchronously input to a FIFO buffer 
and a clock rate is adjusted based upon the "fullness" 
of the FIFO buffer For each interrupt generated by the 
clock a media frame is transferred from the buffer, pack- 
etized and sent over the network to the requesting client. 
In this way the client controls the timing of the media 
frames it receives to assure a continuous stream of me- 
dia frames during editing. 

[0008] The objects, advantages and other novel fea- 
tures of the present invention are apparent from the fol- 
lowing detailed description when read in conjunction 
with the appended claims and attached drawing. 

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF 
THE DRAWING 

[0009] Fig. 1 is a general block diagram view of a dis- 
tributed network for media editing according to the 
present invention. 

[001 0] Fig. 2 is a block diagram view of a media server 
for distributed editing over a network according to the 
present invention. 

[0011] Fig. 3 is a message flow chart for the media 
server according to the present invention. 
[001 2] Fig. 4 is a message sequence chart for the op- 
eration of the media server according to the present in- 
vention. 

DETAILED DESCRIPTION OF THE INVENTION 

[0013] Referring now to Fig. 1 a distributed editing - 
system 10 has a plurality of servers 12, such as Silicon 
Graphics, Inc. workstation, coupled over a network 14, 
such as Ethernet, to a plurality of clients 16 : such as a- 
personal computer having a Windows NT operating sys- 
tem with a Sigma Designs MPEG decoder. One or more 
of the clients 16 may access any one of the servers 12 
at any time, and even access the same server simulta- 
neously. 

[0014] One of the clients 16 requests media frames 
from one of the servers 12 via the network 14. The client 
requests are in the form of command packets. As shown 
in Fig. 2 a network interface 18 in the server 12 receives 
the command packets and routes them to a command 
dispatcher 20. The command dispatcher 20 routes the 
command packets to an appropriate processing module 
depending upon what command is included within the 
packet. Commands may include "Lookup" commands, 
"Register" commands or "Request" commands. 
[0015] A "Lookup" command from the client 16 is a 
search for a particular file or video clip by the client. The 
command dispatch module 20 in the server 12 forwards 
the command to a Lookup command module 22. The 
Lookup command module 22 returns an "id" to the client 
16 for later use in accessing the clip via a file descriptor 
table 24. If the clip is already "open" as a result of a prior 
Lookup command, the "id" is simply returned to the cli- 
ent 16. This provides information to the client 16 about 
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where clips are that it might want to access in performing 

an edit. 

[001 6] A "Register" command from the client 1 6 is for- 
warded by the Command Dispatch module 20 to a Reg- 
ister Client command module 26. The Register Client s 
command module 26 accesses a Client Delivery Handle 
table 28 and returns a destination identifier "did" to the 
client 16. In this manner the server 12 may keep track 
of what clients 16 have accessed it and the clients may 
use the "did" in subsequent requests to notify the server to 
where to deliver media frames. 

[001 7] Once the client 1 6 has located the desired clips 
via the Lookup command and registered with the server 
12 with the Register command, the client now makes 
requests for media frames using the Request command, ts 
The Request command includes the clip "id", the "did" 
and a "tramelist" that includes the frames desired in re- 
sponse to the request. The Command Dispatch module 
20 routes the Request command to a Frame Request 
module 30 The Frame Request module 30 converts the 
'id* and "frarnelist" together with the file descriptor infor- 
mation from the File Descriptor table 24 into a file ad- 
dress, an offset from the start of the file, a count corre- 
sponding to the number of frames requested and the 
delivery identitication. Each media frame in the frarnelist 
is treated individually at this point. 
[0018] A Read module 32 receives the information 
from the Frame Request module 30 and asynchronous- 
ly accesses a file system 34 that retrieves the requested 
media frames one at a time from a storage unit 36, such 
as disk. A Handler module 38 then asynchronously re- 
ceives the media frames one at a time from the file sys- 
tem 34 and provides the retrieved frame to a FIFO Input 
module 40. The FIFO Input module 40 stores each 
frame as received into a media frame first-in/first-out 
(FIFO) buffer 42 and also, either before or after storing 
each frame in the FIFO, checks the "fullness" of the 
FIFO. Based upon the "fullness" the FIFO Input module 
40 provides an adjusted clock rate signal to a FIFO out- 
put clock 46. In this manner the data flow from the media 
server 12 is smoothed out. The FIFO output clock pro- 
vides a periodic interrupt to a FIFO Output module 44 
which extracts a media frame from the Fl FO 42 for trans- 
mission to the requesting client 16. A Send module 48 
receives the media frame from the FIFO Output module 
44 and a destination address from the Client Delivery 
Handle table 28 and produces a media packet which is 
sent via the network interface 18 over the network 14 to 
the requesting client 16. 

[0019] Referring now to Figs. 3 and 4 the message 
flow is in the form of commands (REGISTER, LOOKUP 
and REQ0EST) from the client 16 to a request server 
50 within the media server 12. The request server 50 
processes the REGISTER, LOOKUP and REQUEST 
commands, as indicated above, to provide a delivery 
identification for the client in the Handle table 28 and 
establish a clip identification and to provide frame read 
requests for the file system 34. In response to the asyn- 



chronous read requests the file system 34 retrieves files 
from the disk 36, and in response to handler requests 
the retrieved files on a frame by frame basis are trans- 
ferred to a FIFO Manager 52. The FIFO Manager 52 
provides rate adjustment for the clock 46, stores the 
frames as retrieved from the file system 34, and outputs 
the frame packets to the client 16 in response to the 
clock interrupts. 

[0020] A typical message sequence would start with 
a REGISTER command from the client 16, which binds 
a network address and path to the client. The request 
server 52 returns to the client 16 the destination identi- 
fier ("did"). The client 16 then provides a LOOKUP com- 
mand for a particular clip. The request server 52 asks 
the file system 34 to open the clip, if not already open, 
and the file system returns to the request server a file 
descriptor identifier. The request server 52 then returns 
the clip identifier ("id") to the client 16. The client 16 now 
has the information it needs to make media frame re- 
quests in the form of REQUEST commands to the re- 
quest server 50 that include the clip identifier and deliv- 
ery identifier as a hybrid identifier ("hid") and the number 
of frames from the clip desired- generally from three to 
ten frames per REQUEST command. The request serv- 
er 50 sends a read request to the file system 34 and 
acknowledges the client's request. Upon receipt of the 
acknowledgement the client 16 may send another RE- 
QUEST command to the request server 50 for the next 
group of frames from the clip. Again the request server 
50 forwards a read request to the file system 34 and 
acknowledges the request from the client. 
[0021] The Handler module 38 returns the requested 
frame to the request server 50 which then forwards the 
frame information to the FIFO Manager 52. .The FIFO 
Manager 52 provides a rate command to the.clock 46 
which returns interrupts to the FIFO Manager. The FIFO 
Manager 52 in response to the interrupts outputs to the 
client 16 frame packets for each requested frame. 
[0022] For multiple clients 16 simultaneously access- 
ing a single media server 12 the media frames from the 
Fl FO 42 may be read out by separate Fl FO output mod- 
ules 44 for each client. To avoid "starving" any one client 
16 the FIFO output modules 44 are accessed in a rota- 
tional manner so that packets for each client are sent to 
the network 14 in an intermingled fashion, thus prevent- 
ing the server 1 2 from being "captured" by a single client 
when multiple clients are accessing it. 
[0023] Thus the present invention provides a media 
server that leaves timing to requesting clients by 
processing request commands from clients on a de- 
mand basis, and asynchronously accessing the re- 
quested media files and returning them to the client at 
a sufficient rate so that the client has a steady stream 
of video images to process, regardless of where the 
clips are coming from. 
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Claims 

1 . A method of distributed editing of video clips over a 
network having a plurality of clients and at least one 
media server comprising the steps of: s 



requesting from one of the clients over the net- 
work a portion of a video clip from the media 
server, each portion containing at least one me- 
dia frame; 10 
asynchronously accessing a file system to re- 
trieve the requested portion of the video clip 
from a storage medium; 
asynchronously transferring the portion from 
the file system to a buffer one media frame at is 
a time; and 

transmitting the media frame in the form of net- 
work packets from the media server to the re- 
questing client over the network as a function 
of a local clock rate. 20 



2. The method as recited in claim 1 further comprising 
the step of adjusting the clock rate as a function of 
a current capacity of the buffer to even out the rate 

of transmitting the media frames. 25 

3. The method as recited in claim 1 wherein the trans- 
mitting step comprises the step of transmitting in a 
cyclical manner the media frames in the buffer for 
different clients so that no client is starved for media 30 
frames. 



4. The method as recited in claim 1 further comprising 
the step of registering the client with the media serv- 
er to determine a delivery identification for the client 35 
for the media server, which delivery identification is 
provided by the client as part of the requesting step. 

5. The method as recited in claim 1 further comprising 

the step of looking up a desired clip by the client in 40 
the media server to provide the client with a clip 
identification, which clip identification is provided by 
the client as part of the requesting step. 



so 



SB 



BNSDOCID: <EP 0901249A2J_> 



4 



EP 0 901 249 A2 



12 



12 



10 



MEDIA 
SERVER 1 



CLIENT 
1 

1 

16 



• • 


MEDIA 
SERVER M 


14 

\ 








) 






• • 


CLIENT 
N 





FIG.1 



16 




REGISTER (CLIENT) 
LOOKUP (CLIP) 
REQUEST (F#, hid) 



cid = CLIP ID 

did = DELIVERY INDENTIFIER 

hid = cid + did 

F# = FRAME NUMBER 
RANGE 1 N 



FIG3 



BNSDOCID: <EP 0901249A2J_> 



5 



EP 0 901 249 A2 



12 



34- 



FILE SYSTEM 



32 



DISK 



ASYNCH 
REQUEST 



38 ASYNCH 
( IRESPONSE 36 



READ 



FILE, 
OFFSET, 
COUNT, 
DELIV-ID 



24 



FILE 
DESCRIPTOR 
TABLE 



^ ^ 22 

lookupV) 

CLIENT J 
CMC^/ 



COMMAND 
DISPATCH 



20 



30 



FRAME 
REQUEST 
CMD 



HANDLER 




40 

\ , 


MEDIA 
FRAME 


FIFO 




INPUT 




42 

[ 


ADJUSTED 
RATE 



(id, deliv— id. 
framelist) 



26 



REGISTER 
CLIENT 
CMD 



MEDIA 
FRAME 
BUFFER 
FIFO 



46 



FIFO 
OUTPUT 
CLOCK 
RATE 



28 

DESTINATION 



CLIENT 
DELIVERY 
HANDLE 
TABLE 

17" 



44 



FIFO 
OUTPUT 



MEDIA 
FRAME 



COMMAND 
PACKETS 



1 ± 



SEND 



48 



18 



MEDIA PACKET, 
DESTINATION 



14 



NETWORK 
INTERFACE 



PACKETS 




NET WORK 



PACKETS 



16 



CLIENT 



BNSDOCID: <EP 0901 249 A2 I > 



6 



EP 0 901 249 A2 



O 

o 

I 

o 



CD 



cr 
o 



o 



< 
cr 



cr 
cr 
uj 



00 
Z> 

o 
<c 




o 
m 



A 



00 



lex 



cr 

LJ 
> 

r cr 

LJ 
CO 



CO 



QC 



."2 

Q 
t— i 

V- 

> 
Q 



0) 

E 
o 
c 

13 



UJ 
CL 

o 



e 

o 

T3 



o 
o 



cr 
o 
oo 

UJ 

o 

UJ 



U- 

o 
< 

UJ 

cr 



O 
> — » 

o 



UJ 



+ 



72 
=*fc 



CO 
UJ 
Z> 

o 

UJ 

cr 



u_ 

Q 
2 



01 
UJ 

z> 
o 

UJ 

cr 

u 
o 



CO 
UJ 

a 

UI 

a: 



Jl 



< 
UJ 

cr 



a> 

E 
o 



cr 

UJ 

i 

Q 



E 
o 



3 

Cl 

c 

I— I 

O 
u. 



a> 

£ 

o 



13 

o 
o 



E 
o 



Q. 
3 

o 
o 



oo 

UJ 
ZD 

o 

UJ 

cr 

a 
o 



'sz 



BNSDOCID: <EP 0901 249 A2_L> 



7 



(19) 



3 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



(12) 



(ID EP0 901 249 A3 

EUROPEAN PATENT APPLICATION 



(88) Date of publication A3: 

06.06.2001 Bulletin 2001/23 

(43) Date of publication A2: 

1 0.03.1 999 Bu lletin 1 999/1 0 

(21) Application number: 98304517.0 

(22) Date of filing: 08.06.1998 



(51) mtci7: H04H 1/02, G11B 27/031, 
H04N 7/173, H04N 5/00 



(84) Designated Contracting States: 


(72) Inventor: Tilt, Christopher E. 


AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 


Portland, Oregon 97229 (US) 


MC NL PT SE 




Designated Extension States: 


(74) Representative: Molyneaux, Martyn William 


AL LT LV MK RO SI 


Langner Parry 




52-54 High Holborn 


(30) Priority. 10.06.1997 US 872032 


London WC1V 6RR (GB) 


(71) Applicant: TEKTRONIX, INC. 




Wilsonville, Oregon 97070-1000 (US) 





(54) Server for interactive distribution of audio/video programmes over telecommunication 
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(57) An audio/video media server for distributed ed- 
iting over networks receives requests from clients on the 
networks that include a clip identifier, a delivery desti- 
nation identifier and the frame numbers from the clip de- 
sired. The media server parses the requests and asyn- 
chronously accesses a file system to retrieve the re- 
quested media frames from a storage medium. The re- 



trieved media frames are asynchronously transferred to 
a FIFO buffer, and a clock rate for a local clock is ad- 
justed according to the fullness of the buffer. The media 
frames from the buffer are sent in the form of data pack- 
ets over the networks in response to interrupts generat- 
ed by the local clock. In this manner the timing for the 
media frames is controlled by the clients to assu re a con- 
tinuous stream of video during editing. 
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